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ABSTRACT 

Not very long ago, computer programming was touted as the solution to the problem 
solving crisis in American education, a discipline through which students would 
automatically acquire logical thinking and problem solving skills. More recently, 
however, such notions have gone the way of similar ideas concerning Latin and 
geometry. Research has indicated that problem solving abilities are not automatically 
acquired through computer programming, and programming is accordingly being de- 
emphasized in computer education. Some researchers, however, maintain that computer 
programming might well support the teaching and learning of problem solving, but that 
to do so, problem solving must be explicitly taught. The research reported in this paper 
was designed to investigate such hypothesis. Three studies are described which 
collectively show that five particular problem solving strategies can be developed in 
students explicitly taught those strategies and given practice applying them to solve Logo 
programming problems. The research further demonstrates the superiority of such 
intervention over Logo programming practice along, explicit strategy training with 
concrete manipulatives practice, and instruction in content areas traditionally prescribed 
for the teaching and learning of problem solving. The results indicate that problem 
solving strategies will not be developed through Logo programming alone, rather must 
be explicitly taught and practiced. Knowledge-based instruction linking declarative to 
procedural knowledge of problem solving strategies is recommended as a means to this 
end. The results also suggest, however, that computing environments may be uniquely 
conducive to the development of problem solving skills, in that they support quasi- 
concrete, malleable representations of abstract concepts that can help learners bridge the 
gap between concrete and formal understanding. 
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BACKGROUND 



In 1980, Seymour Papert published Mindstorms. a book which excited many educators 
with its notion that computer programming was fertile ground for the development of problem 
solving abilities. In Mindstoims. Papert (1980) made two claims. First, he argued that the 
computer was a revolutionary educational tool because it supported 'transitional objects to think 
with/ quasi-concrete representations of abstract ideas that could help learners bridge the gap 
between concrete and formal thought Second, he argued that the transition from concrete to 
formal thinking would take place automatically, 'painlessly, and without organized instruction' 
when learners were given computing environments rich in such transitional objects to explore, 
environments such as Papertfs own programming language, Logo. 

Papert's claims have engendered much debate both withia and outside of the Logo 
community. The research reported in this paper w^a designed to investigate e 
relation to the teaching and learning erf particular problem solving strategies. We believe the 
importance of separating the claims fa 

that computing environments can imiquely support the devetopme* t of problem soiving skills - is 
true, whereas the second claim - that this devdopmentwffi happen autam - is not These 
results make sense of the seemingly contradictory reports found in the literature concerning Logo 
programming and the teaching and learning of problem solving ; that investigations which looked 
for the automatic development of problem solving skills resulting from Logo programming 
experience found no such occurrence (Papert, Watt, diSessa & Weir, 1979; Pea AKuriand, 1984; 
Leron, 1985), but that those which investigated mindful interventions combining explicit 
instruction with Logo programming practice reported positive results (Carver & Klahr, 1986; 
Thompson & Wang, 1988; Black, Swan & Schwartz, 1988; de Corte, Verechaffei & Schrooten, 
1989;Lehrer,Sandffio&Raiidle, 1989). 

in this paper, wc will examine the theoretical foundations for our findings concerning each 
of the two daima. We will then discuss the particular problem solving strategies we investigated 
and the problem wiving interventfoa we designed to Finally, we will report on three 

studies we conducted to test Paperfs (1980) claims, and on our cooduskxn based on their 
findings. 

Transitional Objects to Think With.' 

A quarter of a century ago, Marshall McLuhan (1964) advanced the notion that 
communications media are extensions of the human sensory apparatus which alter the ways in 
which we use our senses, and so, the manner in which we perceive ourselves and our 
environment Language, for example, alters the way we p er ce ive the world by normn g and 
defining objects in it, thus allowing us to distinguish between them in ways that would not be 
possible without language. McLuhan argued that the formal nature of a particular medium erf 



communication was therefore more influential in shaping our thought than the content of the 
message it transmitted. 



Whether or not one accepts McLuhan's hypothesis en toto, it seems clear that each medium 
of communication entails unique formal attributes that matter, or that can be made to matter, in 
learning. Salomon (1981), for example, has shown how differing filmic presentations can 
'activate,' 'short-circuit,' or 'model' particular cognitive processes. In this vein, the computing 
medium has been singled out in recent years as particularly supportive of the development of 
problem solving abilities (Feurzig, Horowitz & Nickerson, 1981; Harvey, 1982; Mayer, Dyck & 
Vilberg, 1986; Linn, 1988; Soloway, 1986). The Logo programming language, in particular, has 
been described as an environment designed to "help children to develop problem solving skills, to 
think more clearly, to develop an awareness of themselves as thinkers and learners' (Watt, 1 983 
p. 48). 



Indeed, Seymour Papert (1980), Logo's creator, maintains that computers are truly 
revolutionary educational tools because they support 'transitional objects to trunk with.' His idea 
seems to be that abstract ideas can be represented, manipulated, and dynarmcalry tested in 
computing environments , thereby relieving burdens to working memory and providing students 
with quasi-concrete models of cognitive process that can be easily internalized. Subgoals 
formation, for example, is a problem solving strategy that is given quasi-concrete representation in 
Logo programming in that Logo programs are composed of small subprocedures each of which 
define the means to satisfying particular parts of a larger programming problem Each 
subprocedure, moreover, can be written, tested, and refined by itself before the parts arc 
assembled to create the larger program. Prograrammgm th^ 

model of the abstract process of subgoals formation which can be easily internalized and 
generalized. Papert writes (1980, p. 23), 1 began to see how children who had learned to 
program amn^uters could use very con^ 
about learning . . / 

Papert moreover contends (1980, p. 9), '. . . tfaat^compatttp«8ciK»winaiab^u«to 
so modify the learning environment outside the classroom that much if not all the knowledge 
schwlspreratrytrytotcachwta 

as the child learn, to talk, painlessly, successfully, and without organized instruction.' 
Unfortunately, researchers investigating the effect of computer programming cc. children's 
problem solving skOb found no such link between programming practice and the automatic 
devdc^mentcrfproblmsolvmgab^ 1979; Ehrrkh, Abbott, Salter, and 

Soloway, 1984; Pea & Kuriand, 1984; Leron, 1985; Patterson & Smith, 1986; Shaw, 1986; 
Maridirmch&Iinn, 1987). Their findings have led many educators to discoum an notior* of the 
unique suitability of prograrmmng environment for the development of thinking and problem 
solving skills, and programming is beine accordingly de -emphasized in educational 
q computing 
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programs. In the opinion of certain authors, however, thh is a case of throwing out the baby with 
the bathwater. Programming environments, they argue, most probably are uniquely suited to the 
development of certain higher-order cognitive processes, but such processes are not developed 
automatically, rather must be nundfiwy taught and practiced (Pea & Kurland, 1 984; Leron, 1 985; 
Salomon & Perkins, 1987). 

Indeed, investigations including this sort of mindful intervention have demonstrated that 
Logo prograimning can support the development of. ruk-learning (Gorman & Bourne, 1983; 
Degehnan, Free, Scarlato, Blackburn & Golden, 198o), reflectivity (Clements & GuHo,' 1984;' 
Miller & Enrihovich, 1986), divergent thinking (Clements & Guflo, 1984; Swan & Black, 1989), 
problem representation (de Corte et al, 1989), analogical reasoning (Clements, 1987; Swan & 
Black, 1989), debugging skills (Carver, 1987; Swan & Black, 1989; de Corte et al, 1989), 
subgoals formation (Swan & Black, 1989; de Corte et al, 1989), and forward chaining strategies 
(Swan & Black, 1989); as well as the capacity to apply learned concepts to novel tasks (Lehrer & 
Randle, 1987; Thompson & Wang, 1988; Lehrer et al 1989). Moreover, they have shown that 
problem solving instruction with Logo programming practice better supports such development 
than conventional instruction and practice. These ftadings suggest that computing environments in 
general and the Logo programming environment in particular can be uniquely supportive of the 
teaching and learning of problem solving skills as claimed, but only when those skills are 
specifically identified and nrincirully taught and practiced. 

'Knowledge-Based Instruction.* 

Such findings are really nothing new; they mirror Thorndike's (1 907) results coricerning 
I^tmandtogicalthrnlring. Thomdikecorjcludedthattte 

logical thinking or problem solving would only be internalized and transferred to other domains to 
the extent to which that knowledge was explicitly taught To expndtiy teach higher order skills, 
one needs to specify the knowledge 'ihoee processes require; one needs to premise the design of 
instruction on knowledge outcomes, rather than on bchavk^ outcomes. 

We believe the distinction is a real one. Problem solving instruction, for example, has 
tradrdonalry sought behavioral witcomes. It has focused on the increased abfloy to sctoparticular 
kinds of problems and has accrjrdingly coaccntrated on practice sohdng those rxobiems. This 
doesntwork. While the students in Thorndike's studies might have become better at solving 
particular Latin problems, they end not acquire generalized logical thinking skills that could be 
applied to problems in differing c^mains. Sfanilarry, students in the early Logo studies (Papert et 
al, 1979; Pea & Kurland, 1984; Ixrcn, 1985) migM have becor^ 
jrogramrrrmgrroH^ 

It is our contention that they are not successfY ecause complex cognitive behaviors like 
problem solving involve more than their manifest benaviors and must be addressed at a deeper 



level, at the level of the knowledge structures which support such behaviors. This knowledge has 
two components -- a declarative component, the knowledge of what those specific steps entail, and 
a procedural component, the knowledge of how to perform them. What is missing from 
behaviorally-based problem solving instruction is a declarative focus, an explicit description of the 
steps involved in particular problem solving strategies. Indeed, Anderson (1983) argues that all 
knowledge begins as declarative knowledge and is gradually proceduralized through practice. 

We believe that what is at issue here is the abstraction and generalization of knowledge; that 
an explicit declarative focus is necessary for building knowledge structures that are generalizable. 
We believe that it is not enough to merely give students procedural experience solving particular 
problems, but rather that such experience must be linked with the declarative knowledge of specific 
problem solving strategies, before those strategies can be generalized and applied in differing 
contexts. Just as the naming and defining of objects through language leads to the abstraction of 
their qualities so mat they can be manipulated as objects of thought, so the naming and defining of 
specific problem solving processes decontextuaHzes them so that they can be generalized and 
applied in other dorsums. This is what we did in designing the Logo-based problem solving 
intervention we used in our studies. We began with a focus on the declarative knowledge 
underlying six specific problem solving strategies. 

Problem Solving Strategic*. 

A number of distinct problem solving strategies can be distinguished within behaviors 
considered general problem solving (Wkklegren, 1974; Newell & Simon, 1972). Certain of these 
seem more applicable to programming problems in general, children's p rogr ammi ng in particular 
(Clements & GuHo, 1984; Lawter, 1985; Clement, Kurland, Mawby & Pea, 1986). Wc 
performed task analyses based on Polya's ( 1 973) decomposition of the problem solving process of 
the six particular problem solving strategies we believed would be most applicable to Logo 
programming. These were subgoais formation, forward chaining, backward chaining, systematic 
trial and error, alternative representation, and analogy. A description of each follows. 

Subgoais fo rmflffon, 

Subgoais formation refers to breaking a single difficult problem into two or more simpler 
problems. Subgoais formation might thus be seen as the mapping of a problem space. Even when 
no obviously solvable subgoais can be found, breaking a problem into to com 
its sohrtion less formidable, more manageable, and less susceptible to errors. Subgoais formation 
can be described by the foDowing four steps: 

1. Problem definition. Specify the problem. 

2. Subdivision. Examine the problem specification to see where it can be broken into 
smaller, self-contained problems. Specify these and their connections to the larger 
problem. 



L^^^T 651 ^^. b , lem * generated for grain aze and further decomposition If 

sa^Mtas^. 

Whfle subgoals formation might seem an obvious strategy to adults, it is not at all obvious 
to many children (Carver & Klahr, 1 986), therefore it is a good candidate for explicit instruction 
Moreover, of all the problem solving strategies, it can mast clearly be implemented and concretized 
in Logo prograrmning. In Logo, small' subprocedures are easily written and placed in the 
workspace. Because thesecan be called from anywhere ina program a progrm can simply be a 
Hst of such subprocedures, a very concrete representation of the subgoals that make up a 
programming solution. 



Forward chflrmny, 

Forward chaining is a species of means-ends analysis (Neweil & Simon, 1972) which 
involves working from what is given in a problem towards the problem goal in step-by-step, 
transformational increments that bring one progressively closer to that gcaL The forward chaining 
process can be deconiposed into the following steps: 

l^SlSF" ^ ttepr ° Wem « 0aL Specify what is given. Specify the 

^SSlS^ 1 ^ desired goa ^ ^ ™* tramfo -mauon Test to see 
whetr^teti^cT^ KSs^rXsS 

t^^^L^^ trar^ormatkxi a new given. Repeat steps 2 and 3 using the new 
given. Conimuemthismannerimfflthe 

A r^gramming environment, esrxxdally anmterpreted enviromnem like Logo, is inherentiy 
supportW the forward c^^ Transformations can be implemented, their effects 

accessed, and successful changes instantiated as 

A program can thus be developed in incremental steps and such developcamt provide a concrete 
m^telofthefccwardchainmgproc^. An important part of forward chaining, however, involves 
JieaMitytochoc^ar^opria^ 

onenearer problem solution. Forward durfning thus requires some sort (rf mental model of the 
problem space, and is not, therefore, typically a novketechrnqne (Greeno & Simon, 1984). 

Backward rJi^ng 

Backward chaining, however, is typically a novice problem solving strategy (Greeno & 
Simon, 1984). Backward chaining focuses on the goal state and tries to dednce a pr^cedmg state 



from which that goal could be derived, men a staie torn which that state could be derived, and so 

on^taekwurdtowtrntisgiventaapsoblem. He backward chaining process consists of 
the following four steps: 

1. Problem definition. Specify the goal state. Specify Misgiven in the problem. 
^Decoxnpc«ticm. Specify a state that could be tranrfonnadiatotheg<>al 9 tatema 8 higle 

itlsdosertowh^ 

4. Recrosion. Otherwise, make fee specified state a new goal state and reneat ^ 9 „„h q 

Backward chaining is a particularly useful tedmique when a problem ha, a untaehr 
speeded goal, and/or is a situation in which the Inputs and outpuis of the WormaSons can be 
urnquelyspeoffiedOVfcklegren. 1974). Such is often the case in progranmdn* problem,, todcvi, 
^ff^iBsb^^mcd^^cad^CBo^,^. Moreover.inasmuehas 
ft is typically a novice techJque, backward chaining might be more available to children 
However, backward chaining has no real analog in Logo programming as one cannot bufld 
programs backwards. 



Systematic trial ft 

Systematic trial and error involves the recursive testing of possible solution, in a 

Kdtf^fromf^ 
theeltotioncfpc^ 

systematic testing of «uch parfbffitk* rather t^ ^ Ux55tepa 
farvorvedin the systematic trial and error process include: 

1. Probkmcferhntkm. Specify the problem goaL 

2. Approximate sctokxi. Create and intplement a plan to solv^ 

t^^l^f^S^ ^8°^^ cliscxrpa^ to revise the plan, and 
SdgoT Continoe m tins manner until the instantiated solution maWsX 

Piaget (Ginsberg AOppcr, 1 979) believed that the application of systematic trial and 
^eswa^animpcctantdeternmiantrf Systematic trial and ^, 

then. Is an obvious candidate for testing Paperta ( 1 980) notion mat progranmtin* environments 



error 
error, 



Er|c 8 



support the concretizing of the formal. Certain types of graphics programming, moreover, are 
paradigmatic of systematic trial and error strategies. Debugging also makes use of, and provides 
symbolic representations for, such techniques (Carver, 1 987). 

AltemaUvorepresentfltiori . 

Alternative representation involves conceptualizing a problem from differing perspectives. 
Polya (1973) writes that often the way a problem is stated is really all that makes it difficult, that 
simple restatement will make its solution obvious. Alternative representation is thus the antidote to 
functional fixedness (Dunker,, 1945). Alternative representation can be decomposed into the 
following four-step description: 

1. Problem definition. Specify the problem. 

2. Alternatrverepresentation. Generateanalternativeproblemspecification 

3. Evaluation. Test to see whether the new problem specification suggests problem 
solution. If it does, solve the problem. 

4. Recursion. Otherwise, repeat steps 2 and 3 by generating and evaluating other problem 
specifications until a problem solution is found. 

Programming is conducive to the development of alternative representations both because 
there are never single correct solutions to r^gramming problems, and because differing 
representations can quite easily be instantiated and pragmatically tested in programming 
environments. Indeed, Clements and GuHo's (1 984) study of the effects of Logo programming on 
young children's cognition found significant increases in their ability to produce alternative 
representations. State's (1973) finding of significant increases on permutation tasks may also 
support this view. However, their is no clear analog in Logo programming for alternative 
representettoostrategks. 

Analogy involves the discovery of a particular similarity between two things otherwise 
more or less unlike, and *a mapping of knowledge from one domain (the base) onto another (the 
target) predicated on a system of relations that holds among the objects of both domains.* 
(Gentner, 1987) An important factor in this process, especially in problem solving contexts, is 
goal-re^tedneas, how one domain is like another wife respect to a specified goal (Kolyoak & Koh, 
1987). The use of anatogymproWm solving can be deamiposedmto the folkxwing steps: 

1. Problem definition. Specify the desired goaL Specify the base and the target systems. 

2. Mapping. Perform a mapping between the base and target systems. 

3. Evaluation. Test the soundness of the match in terms of both structural smiilarity and 
pragmatics (goal related conditions). If the analogy generated meets the goal conditions, 
and fte structural similarity between the base and the target holds, the mapping is sound 
Use the base domain solution to generate a solution m the target domain. 
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4. Recursion. Otherwise, return to step 1 and specify a new base domain. Apply steps 2 
and 3 to it Continue in this manner until an adequate representation is discovered. 

Programming environments inherently support the development of analogy in that one is 
always mapping between computer code (a formal representation) and program output (a concrete 
representation), and recursion, an important Logo programming technique, is a form of analogical 
reasoning. Recursion, however, is confusing to most adults. None-the-lesa, Doug Clements 
( 1 987) found significantly better analogical reasoning among students with prior Logo experience. 
Analogy, moreover, is the basis for all transfer, thus a critical element in the research we designed. 

***** INSERT FIGURE 1 ABOUT HERE ***** 

These six problem solving strategies -- subgoals formation, forward chaining, backward 
chaining systematic trial and error, alternative representation, and analogy can be more or leas 
concretely represented, then, within a Logo programming context We accordingly designed our 
instruction and our testing procedures around them The instruction was split into units, one for 
each strategy. Each unit began with explicit mstruction on a particular strategy (declarative 
knowledge) in which wall posters which enumerated the steps involved in each strategy (FIGURE 
1) were presented and discussed. This was followed by mediated practice (Feuerstein, 1980; 
Deletes, Littkfieki & Bransford, 1 985; Como, 1 986) solving problems designed to be particularly 
amenable to solutions employing that strategy (procedural knowledge). An example of a problem 
set is given in FIGURE 2. We likewise created six separate tests, each designed to measure 
students' facility in applying specific strategies to non-computing problems. (See APPENDIX.) 
Our goal was for students to transfer the strategies learned in the intervention to the paper and 
pencil tasks of the problem solving tests. 

***** INSERT FIGURE 2 ABOUT HERE***** 
STUDY ONE 

Study One was a pilot study concerned with testing the efficacy of the intervention we 
designed for supporting the development of six particular problem solving skilla. Within that 
context, two factors we believed might effect such development were also manipulated and 
examined. The first of these was the specific Logo practice environments utilized In particular, 
we thought that students might be more likely to develop problem solving strategies practiced 
within both the graphics and the list- processing programming environments, but wc also thought it 
was possible that one or the other of these environments alone would be more supportive of the 
development of particular strategies. The second factor we thought might influence the 
effectiveness of the instruction was the grade levels of the subjects involved. Specifically, we 
thought there might be developmental differences in students' propensity to develop particular 
problem sotvtng strategies, study One thus examined three Interrelated questions: 

fo 
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1. Can the Logo pTOgramining environment support the development of subgoals 
formation, forward chaining, backward chaining, systematic trial and error, alternative 
representation, and/or analogy strategics when those strategies are explicitly taught and 
practiced? 

2. Do differing practice environments within Logo programming differentially efiect the 
likelihood thatsuch strategies will be developed within tlmt instructional context? 

3 . Do developmental differences differentially effect the the development of such strategies 
will be devel oped within that instructional context? 



Subjects. 

Subjects were 1 33 fourth through eighth grade students in a private elementary school. 
All subjects had at least 30 hours previous Logo programming experience. 

Methodology. 

All subjects were given papcr-and-pcncil exercises testing their ability to apply six 
problem solving strategies - subgoals formation, forward chaining, backward chaining, 
systematic trial and error, alternative representation, and analogy - and randomly assigned by 
grade to one of three treatment groups receiving respectively graphics, Hst processing, or 
graphics and list processing practice problems. All subjects received training in each strategy, 
then were asked to solve four practice problems particularly amenable to solutions involving 
that strategy. On completion of all six strategy units, subjects were post-tested using different 
but analogous exercises. Mean pre-test scores were compared between groups using one-way 
*tialysisof variance and found to be statistically equivalent (F2, 130 m 1.50, p > .10), hence, 
treatment groups were assumed to be generally equal in problem solving ability before 
treatment Raw scores on all tests except thoee for alternative representation were converted to 
percent correct scores and compared using a four-way analysis of variance. Independent 
variables were test, strategy, dass (grade level), and group. The dependent variables were 
scores on the strategies tests. Because they had no maximum possible correct, alternative 
reprcacntatioos measures were evaluated separately using a three-way analysis of variance. 

Results. 

Significant differences were found between subjects ' mean pre- and post- test scores for 
all problem solving strategies except backward chaining for subjects in aK treatment groups. 
These results demonstrate the effectiveness of the instruction we designed for supporting the 
development of subgoals formation, forward chaining, systematic trial and error, 
alternative representation, and analogy strategies. The intervention was not shown to be 
effective for the teaching and learning of backward chaining strategies, nor were differing 
practice environments found to differentially effect strategy development The results also 
revealed developmental differences in students' facilities for both using and developing 
particular problem solving strategies. Not surprisingly, older students were better than 
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younger ones at applying all strategies. They were also more likely to benefit from instruction 
and practice in alternative representation and analogy strategies, while younger students 
benefited more than older ones from instruction and practice in subgoals formation strategies. 



TABLE 1 

Study One; ANOVA Table for Subgoal* Formation, 
Forward Chaining, Backward Chaining, Systematic Trial & Error, and 
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TABLE 1 shows the results of the four-way analysis of variance comparing students' 
strategy measure scores in Study One* Significant main effects for dass (F2,H8 " 12.86, p < 
.01),test(Fi >118 - 170.86, p<. 01), and strategy (F 4f4 72 - 1.71.72, p < .01) were found. No 
significant main group effect was discovered (F2JI8 " 1-68, p > .10). TABLE 2 shows the 
results of the three-way analysis of variance comparing students 9 alternative representation 
scores.. Again significant main effects were found foe class (F4JI8 - 6.02, p < .01) and test 

0^1,118 " 1 - 37 » P<- 01)t tort no main group effect was founding " 1.05, p> .10). 

The main class effect indicates developmental differences in students' problem solving 
abilities. Students' mean scores for all problem solving strategies rose with increasing grade 
levels , indicating that older students were more adept at utilizing the strate gies than younger ones . 
This effect, although expected, supports views linking problem solving with formal operational 
skills. The main test effect indicates significant pre- to post-test differences across strategies for all 
grade level* and treatment groups. Soch increases argue for the success of the instruction tested. 

The main strategy effect indicates significant differences between mean scores on the various 
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strategy measures. Because these measures were not designed to be equivilant, however, the 
effect is not meaningful. The Lack of a group effect indicates no significant differences between 
treatment groups, thus that differing practice environments within Logo had no effect on the 
efficacy of the instruction we designed. 



TABLE 2 

Study One; ANOVA Table for Alternative Representation 





SS 


MJMT 


we 


p 
r 


iKUD 


MEAN 


3389956.9 


1 


3389956.9 


2248.39 


0.0000 


CLASS 


36310.0 


4 


9077.5 


6.02 


0.0002 


GROUP 


3170.5 


2 


21589.2 


1.05 


0.3518 


CG 


19551.9 


8 


2444.0 


1.62 


0.1259 


ERROR 


177911.7 


118 


1507.7 






TEST 


115234.5 


1 


115234.5 


137.78 


0.0000 


TC 


14196.0 


4 


3549.0 


4.24 


0.0030 


TO 


1599.8 


2 


799.9 


0.96 


0.3873 


TCO 


7734.4 


8 


966.8 


1.16 


0.3316 


ERROR 


98694.5 


118 


836.4 







The four-way analysis of variance also examined eleven interaction effects. Significant 
strategy by class (Fi 6>47 2 - 7.73, p < .01), test by strategy 0*14,472 - 14.79, p < .01), and test 
by strategy by class (Fj 5^472 - 2.59, p < .01) effects were discovered Hie test by strategy effect 
indicates differences in pre - to port- test changes between the five problem solving strategies tested. 
An examination of the simple test effect at each level of strategy reveals significant test effects for 
all of these except backward chaining, indicating that students developed subgoals formation, 
forward chaining, systematic trial and error, and analogy strategies as a result of the intervention 
(FIGURE 3). A similar result was found for measures of alternative representatkxL Such results 
argue strongly for the success of the intervention, and support the finding erf a main test effect 

***** INSERT FIGURE 3 ABOUT HERE ***** 

Ukewise, a cloaer examination of the strategy by class interaction supports the finding of a 
main effect for class. Simple class effects were found at all strategy levels except backward 
chaining, indicating developmental differences in students' problems solving abffitfcs, with older 
students generally scoring higher than younger ones on the various strategy measures (FIGURE 
4). In addition, a finer grained analysis of the test by strategy by class interaction indicates 
developmental differences in students' propensity to develop particular strategies. Progressively 
weaker test effects were found at increasingly higher grade levels for subgoals formation 
measures, and progressively stronger test effects were found at increasingly higher grade levels for 
measures erf analogy. A seperate analysis also revealed progressively stranger test effects at 
increasingly higher grade levds for alternative representation measures. Such results hint at 
developmental differences in students' readiness to develop certain problem solving strategies, in 
particular, that younger studentswere more ready to develop subgoals formation strategies, and that 
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older students were more ready to develop alternative representation and analogy strategies, 
***** INSERT FIGURE 4 ABOUT HERE ***** 

Discussion 

The results of Study One strongly suggest that the instruction we designed supports the 
development of five particular problem solving strategies « subgoals formation, forward chaining, 
systematic trial and error, alternative representation, and analogy - but not the development of 
backward chaining strategies, among the population tested. While the positive increases observed 
on these strategy measures might also have resulted from practice and/or maturation, the size of the 
increases and the lack of shrilar increases on backward chaining measures argue that such was not 
the esse. The results also suggest that differing practice environments within Logo programming 
have little effect on the success of such iatruction. Finally, the results point to developmental 
differences in students' facility with and propensity to develop particular problem solving skills. 
Specifically, we found that older students were more likely to develop alternative representation 
and analogy strategies, whereas younger students were more likely to develop subgoals formation 
strategies. 

STUDY TWO 

Study Two was concerned with validating the results of Study One with reference to 
meaningful controls; in particular, with assessing the importance of Logo program m ing within the 
instruction we designed, and with differentiating between that intervention and discovery learning 
approaches. Study Two investigated the differing efficacies of explicit problem solving instruction 
with Logo programming practice vs. discovery learning in a Logo pro gramming environment, and 
the Logo programming environment vs. a concrete manipulative* practice environment for 
supporting the development of the five problem solving strategies on which students showed 
improvement in Study One - subgoals formation, forward chaining, systematic trial and error, 
alternative representation, and analogy. Two research questions were addressed; 

1. Is explicit problem solving instruction with Logo programming practice superior to 
discovery learning in a Logo progr ammin g environment for supporting the development of 
five particular problem solving strategies ~ subgoals formation, forward chaining, 
systematk:trial and error, alternative representation, and analogy? 

2. Is the Logo programming domain particularly supportive of the teaching and learning of 
problem solving? 

Subjects. 

Subjects were 100 fourth through sixth grade students at the same private elementary 
school where Study One was completed All had at least 30 hours previous Logo programming 
experience. 
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older students were more ready to develop alternative representation and analogy strategies, 
***** INSERT FIGURE 4 ABOUT HERE ***** 

Discussion 

The results of Study One strongly suggest that the instruction we designed supports the 
development of five particular problem solving strategies subgoals formation, forward chaining, 
systematic trial and error, alternative representation, and analogy - but not the development of 
backward chaining strategies, among the population tested. While the positive increases observed 
on these strategy measures might also have resulted from practice and/oi maturation, the size of the 
increases and the lack of similar increases on backward chaining measures argue that such was not 
the case. The results also suggest that differing practice environments within Logo programming 
have little effect on the success of such intruction. Finally, the results point to developmental 
differences in students' facility with and propenrity to develop particular problem solving skflls. 
Specifically, we found that older students were more Hkrfy to develop alternative representation 
and analogy strategies, whereas younger students were more likely to develop subgoals formation 
strategies. 

STUDY TWO 

Study Two was concerned with validating the results of Study One with reference to 
meaningful controls; in particular, with assessing the importance of Logo programming within tl e 
instruction we designed, and with differentiating between that intervention and discovery learning 
approaches. Study Two investigated the differing efficacies of explicit problem solving instruction 
with Logo programming practice VS. discovery learning fa a I^goprngr fl mmfag ^ v imnm^it, and 
the Logo programming environment vs. a concrete manipulative* practice environment for 
supporting the development of the five problem solving strategy on which students showed 
improvement in Study One - subgoals formation, forward chaining, systematic trial and error, 
alternative representation, and analogy. Two research questions were addressed: 

1. Is explicit problem solving instruction with Logo programming practice superior to 
discovery learning in a Logo programing environing 

five particular problem solving strategies - subgoals formation, forward chaining, 
systematic trial anderror, alternative representation, and analogy? 

2. Is the Logo programming rinnu*fa pftrti<?ifarty supportive of the teaching and learning of 
problem solving? 

Subjects. 

Subjects were 100 fourth through sixth grade students at the same private elementary 
school whete Study One was completed. All had at least 30 hours previous Logo programming 
experience. 
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Methodology. 

All subjects were tested on their ability to apply the five problem solving strategies on 
which subjects improved in the first study ~ subgoals formation, forward chaining, systematic trial 
and error, alternative representation, and analogy. They were then randomly assigned by grade to 
one of three treatment groups receiving respectively explicit problem solving instruction with Logo 
graphics practice, explicit problem solving instruction with cut-paper manipulatives practice, or 
Logo graphics programming problems without strategy training. On completion of all treatments, 
subjects were post-tested using different but analogous tests. Mean pre-test scores on measures of 
subgoals formation, forward chaining, systematic trial and error, and analogy were compared 
between groups using one-way analysis of variance and found to be statistically equivalent (F2, 97 

- 0.33, p > . 10), hence, treatment groups were assumed to be generally equal in these problem 
solving abilities before treatment Subjects' scores on the alternative representation pre-test, 
however, were not statistically equivalent ($2,97 " 4,99, p < .01). Students receiving problem 
solving instruction and Logo programming practice scored lower on the pre-test than students 
receiving Logo programming practice alone who scored lower than students receiving problem 
solving instruction and cut-paper manipulatives practice. 

On completion of all treatments, subjects were post-tested using different but analogous 
tests. Raw scores on all tests except thoee for alternative representation were converted to percent 
correct scores and compared using a three-way analysis of variance. The independent variables 
were test, strategy, and group. The dependent variables were scores on the strategies tests. 
Because they had no maximum possible correct, alternative representations measures were 
evaluated seperately using a two-way analysis erf variance. 

Results. 

Significant differences in pre - to post-test increases were found between treatment groups 
indicating that subjects receiving explicit problem solving instruction and Logo pro gramming 
practice, and that group afcoc, improved in subgoals formation, forward chaining, systematic trial 
and error, a nd analogy strategies. Increased ability in applying alternative representatton strategy 
was aiaoindicated for this group but not conclusively cknwnstrated The results thus argue for the 
superiority of explkdtinstnxtkxi and Logo programming practice over both similar instruction with 
cut-paper manipulatives practice and discovery learning in a similar practice environment for the 
teaching and learning of problem solving, 

TABLE 3 shows the results of the three-way analysis of variance comparing students' 
strategy measure scores in Study Two. Significant main effects were found for all independent 
variables (group, F 2 ,97 m 12.81. p < .01; test, - 5.94 f p < .05; strategy, F3 f 29i - 

207.1 1, p < .01), indicating significant differences along all three dimensions. Of these, only the 
group effect is partknilariymeamngfuL The strategy effect is not meaningful because the differing 

16 



strategy measures were not designed to be equivilanL The test effect indicates significant pre- to 
post-test changes, but these could have resulted from practice or maturity and not from the various 
interventions. 

TABLE 3 

Study Two; ANOVA Table for Subgoals Formation, 
Forward Chaining, Backward Chaining, Systematic Trial A Error, and 







Analogy 










SS 


DF 


MS 


F 


PROB 


MEAN 


2074999.0 


1 


2074999.0 . 


1568.08 


0.0000 


GROUP 


33907.5 


2 


16953.7 


12.81 


0 0000 


ERROR 


128357.9 


97 


1323.3 






TEST 


1576.6 


1 


1576.6 


5.94 


0.0166 


TO 


6871.7 


2 


3437.3 


12.96 


0.0000 


ERROR 


25735.0 


97 


265.2 






STRATEGY 


283190.9 


3 


94397.0 


207.11 


0.0000 


SG 


13478.6 


6 


2246.4 


4.93 


0.0001 


ERROR 


132630.9 


291 


455.8 






TS 


2274.2 


3 


758.1 


3.64 


0.0132 


TSG 


743.4 


6 


123.9 


0.60 


0.7338 


ERROR 


60540.8 


291 


208,0 







The group effect, however, clearly indicates differences between groups resulting from the 
various interventions. Because the groups were statistically equivalent before receiving treatment, 
but significantly different overall, the group eff ect indicates differences in problem solving strate gy 
skills resulting from differences in the intervention. This result is exxroborate^ 
test by group interaction ^97 - 12,96, p < .01), indicating differences in pre- to post-test 
changes resulting from the differing treatments. This interaction was examined in greater detail by 
assessing the simple test effect at each level of group , A strong test effect was found for the group 
recieving problem solving instruction and Logo prog rammi ng practice, and for that group alone. 
Students in receiving problem solving instruction and Logo programming practice improved an 
average of 11.1 percentage points on the four strategy measures, while the scores of students 
receiving similar instruction but cut-paper manipulativcs practice remained essentially the same, 
and the scores of students receiving Logo programming practice alone actually declined sHghtty, 
although not significantly. FIGURE 5 illustrates these r suits. The findings demonstrate that the 
inte rvention we designed, and that intervention alone, resulted in frignfficant increases in students' 
problem solving abilities in four areas - sub goals formation, forward rh*ining t systematic trial and 
•r error, and analogy. They argue for the superiority of explicit problem solving instruction and 
Logo p r o gr ammi ng practice over both similar instruction with manipulative* practice *nd Logo 
programming alone. 

INSERT FIGURE 5 ABOUT HERE 
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The results of the analysis of variance for alternative representation measures (TABLE 4) 
is problematic. Significant main effects were found for group (F2 97 * 4. 1 3, p < .05) and test ( 
F 2,97 " 10 -55, p < .01). Because Jie groups were not equivalent to begin with, the group effect 
is not meaningful. Indeed, an examination of group means show?? that all groups improved on 
alternative representation measures, thus, the test effect is not meaningful either. What would be 
meaningful would be a solid test by group interaction. Unfortunately, the analysis of variance 
reveals only weak significance for the interaction (F2 f 97 - 2.57, .05 < p < .10). 



TABLE 4 

Study Two; ANOV A Table for Alternative Representation 





SS 


DF 


MS 


F 


PROB 


MEAN 


19113259.6 


1 


19113259.6 


563.35 


0.0000 


GROUP 


28058.5 


2 


14029.3 


4.13 


0.0000 


ERROR 


329431.8 


97 


3396.2 






TEST 


24819.1 


1 


24819.1 


10.55 


0.0016 


TO 


6631.9 


2 


3315.9 


157 


0.0821 


ERROR 


125363.8 


97 


12922.4 







The simple test effect was none-the-less assessed at each level erf group to examine the test 
by group interaction in greater detail. A strong test effect was found for the group receiving 
problem solving instruction and Logo programming practice (Fj ^97 « 18.91, p < .01), whereas 
only a weak test effect was found for the group receiving problem solving instruction and 
cut-papermanipulatft^ -3.61, .05 <p < .10), and no test effect at all was found 

for the group receiving Logo programming practice alone (Fi 97 - 1.81, p > .10). FIGURE 5 
illustrates the differences in pre- to post-test changes between groups. It can be seen that the group 
receiving problem, solving instruction and Logo programming practice improved more than twice 
as much as either the group receiving instniction with cut-paper mm 

receiving Logo programming practice ak»e. Because students in the explicit instruction - Logo 
programming group had lowtr scores 011 alternative representation measures to begin with, 
however, the greater gains they made might be attributed to differential ability levels rather than the 
intervention. Thus, the most we can conclude is that it is possible that students in the Logo 
graphics group showed greater iiKxeases on measures of alternative represent 
intervention we designed. 

Discussion 

The results of Study Two argue strongly for the superiority of explicit problem solving 
instruction and Logo programming practice over both similar instruction with manipulative* 
practice and discovery learning in Logo progr am m in g environments for the development of four 
problem solving strategies - subgoals formation, forward chaining, systematic trial and error, and 
analogy. Indicattons are that sixA pedagogy may 
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alternative representation strategies as well. In terms of the research questions, then, we can 
conclude that explicit problem solving instruction with Logo programming practice is more 
supportive than Logo discovery learning environments of the development of those strategies, and 
that the Logo programming environment itself is more supportive erf such development than 
concrete manipulative*. The findings thus support Paperfs (1980) contention that abstract ideas 
can be concretely represented on computers in ways that help students bridge the gap between 
concrete and formal thought, but argue against his claim that such transition will take place 
automatically when students work within Logo programming environments. 



STUDY THREE 



Because Studies One and Two utilized the same teachers and similar student populations, 
we had some question about the general application of the instruction we designed. Study Three 
was thus concerned with validating the results of the first two studies with a different teacher and a 
differing student population. Because the controls used in this study involved regular classes in 
formal mathematics and programming, it also investigated the differing efficacies of that instruction 
vs. regular instruction in domains typically prescribed for the tra^Jrfng and learning of problem 
solving. Study Three, then, explored the following questions: 

1 . Does explicit instruction and mrrHftteri T r>go prog ramming prartW? support thr trarHng 

and learning of five particular problem solving strategies - subgoals formation, forward 
chaining, systematte trial and error, alternative representation, and analogy — among high 
school students? 

2. Is explicit problem solving instruction with Logo programming practice superior to 
regular instruction in mathematics and programming for supporting the development of 
such strategies? 

Subjects. 

Subjects were 40 eleventh and twelfth gi^ students at an Am 
enrolled in one of three classes ~- a Logo class, an Advanced Placement (AP) Pascal class, or a 
Pre-Cakulus class. No subjects had any previous Logo progr amm ing experience . 



Methodology. 

AH subjects were given paper-and-pencQ tests of their ability to apply the five problem 
solving strategies on which subjects improved in the first study. Subjects in the Logo class 
received explicit problem solving instruction and Logo programming practice in each strategy. 
Subjects in the APPaacal and Prc<^ Mean 
pre-test scores were compared between groups using one-way analysis of variance and found not 
to be statistically equivalent (F2 t 37 - 12.76, p < .01), hence groups could not be assumed 

generally equal in problem solving ability before treatment An examination of group means 
rtVMkd that th* Logo group scored rignfflcantfy lower than ttudttrta in both the AP Patcal and 
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Pre-Calculus groups on pre-test measures. On completion of all treatments, subjects were 
post-tested using different but analogous tests. Raw scores on all tests except those for alternative 
representation were converted to percent correct scores and compared using a three-way analysis of 
variance. Independent variables were test, strategy, and group. The dependent variables were 
scores on the strategies teste. Because they had no maximum possible correct, alternative 
representations measures were evaluated seperately using a two-way analysis of variance . 

Results. 

Significant differences in pre- to post-test increases were found between groups. Further 
analysis of this finding revealed that subjects in the Logo class showed significantly improved 
subgoals formation, forward chaining, and systematic trial and error strategies. Increased ability in 
applying alternative representation strategics was also indicated but not conclusively demonstrated 
for this group. The results argue for the superiority of explicit strategy training and Logo 
programming practice over regular instruction in subjects traditionally prescribed for the teaching 
and learning of problem solving and demonstrate the efficacy of the instruction we developed with 
a very different student population- 

TABLE 5 

Study Three; ANOVA Table for Subgoals Formation, 
Forward Chaining, Backward Chaining, Systematic Trial & Error, and Analogy 





SS 


DF 


MS 


F 


PROB 


MEAN 


1220349.2 


1 


1220349.2 


1014.79 


0.0000 


GROUP 


1509.4 


2 


754.7 


0.63 


0.5395 


ERROR 


44494.6 


37 


1202.6 






TEST 


1540.2 


1 


1540.2 


10.07 


0.0030 


TO 


3536.4 


2 


17683 


1136 


0.0001 


ERROR 


5657.4 


37 


152.9 






STRATEGY 


29113.7 


3 


9704.6 


29.56 


0.0000 


SG 


81443 


6 


1357.4 


4.13 


0X009 


ERROR 


36444.4 


111 


3283 






TS 


1483.3 


3 


494.4 


3.54 


0X170 


TSG 


1083.8 


6 


1803 


139 


03663 


ERROR 


15493.5 


111 


139.6 







TABLE 5 shows the results of the three-way analysis of variance for subgoals formation, 
forward chaining, systematic trial and error, and analogy in Study Three. Significant main effects 
were found for test (F2, 37 - 10.07, p < .01) and strategy (P$ t iu - 29.56, p < .01), but not for 
IP 00 ? (F2,37 ■ °- 63 » P > - 10 )- Significant test by group 0^37 - 11.56, p < .01), test by 
strate Sy (^3, 111 " 3.54, p< .05), and strategy by group (F6 t in "4.13, p< .01) interactions 
were also found. The results of the analysis of variance of scores on alternative representation 
measures is shown in TABLE 6. It reveals significant main effects for group (F137 " 7.69, p < 
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.OOandtestflPi^? = 5. 86, p<. 05), but no test by group interaction (F2,37 - 1.65, p<. 10). 



TABLE 6 

Study Three; ANO V A Table for Alternative Representation 





SS 


DF 


MS 


F 


PROB 


MEAN 


700315.1 


1 


700315.1 


300.29 


0.0000 


GROUP 


35877.8 


2 


17938.9 


7.69 


0.0016 


ERROR 


86290.1 


37 


2332.2 






TEST 


4310.8 


1 


24819.1 


5.86 


0.0205 


TG 


2431.2 


2 


1215.6 


1.65 


0.2055 


ERROR 


27228.5 


37 


735.9 








The main test and strategy effects are not particularly meaningful as previously explained 
Indeed, the group effect found for alternative representation measures is not meaningful either 
because the groups were not equivalent to begin with. The lack, of a group effect in the three-way 
analysis of variance, however, is meaningful because it reveals that groups which were not 
statistically equivalent before treatment became equivalent after treatment Because students in the 
Logo group scored lower on pre-test measures than students in the other two groups, the lack of a 
group effect indicates an imp! ovement in their scores resulting from the intervention. This result is 
corroborated by the finding of a test by group interaction which indicates differences in pre- to 
post-test changes resulting from differing treatments. This interaction was examined in greater 
detail by assessing the simple tests effect at each level of group. A strong test effect was found for 
the Logo group (F137 - 46.99, p < .01), but no test effect was found for the other two groups, 

indicating that the Logo group, and the Logo group alone, improved across all four strategy 
measures tested. 



***** 
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FIGURE 6 illustrates these differences. Notice that students in the Logo group appear to 
have significantly increased 001 all measures except analogy. Indeed, looking at the simple test 
effect at each level of group and strategy, we discovered a strong test effect for students in the 
Logo group on subgoals formation, forward chaining, and systematic trial and error measures (p < 
.01), but no test effect at allfor analogy measures (p> .10). A possible explanation for tie lack of 
improvement on tests of analogy (especially considering that older «***Vr*\*i in the first study 
improved the most on these measures) is that the analogy test itself was too easy for the high 
school students tested in Study Three. Indeed, students in this study scored so high on the 
analogy pre-testthat there was Etfle room for improvement on the poet-test 

A significant simple test effect was also found for students in the Pre-Cakulus group on the 
systematic trial and error measure (p < .05), indicating that students in this group developed 
systematic trial and error strategies to some extent, but significant diff erence* wvre *t£Q found 

between this group and the Logo group on the systematic trial and error measure. No simple test 
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Lehrer et al, 1989; Swan & Black, 1989), We believe the reason why such mrtruction is 
necessary is that students need generalizable declarative knowledge of particular problem solving 
strategies in order to decontextuaHze such knowledge from programming and apply it in other 
domains. In the instruction we designed, problem solving strategies were broken into their 
component steps and explicitly taught Students were thus provided with declarative knowledge of 
the problem solving strategies to be learned. 

Declarative knowledge of particular problem solving strategies, however, is not in itself 
enough to ensure their development, as shown by Study Two. Procedural knowledge is also 
necessary. It is our belief that Seymour Papert ( 1 980) is right; that computing environments, Logo 
programming environments in particular, are uniquely conducive to the development of such skills 
because they support quasi-concrete representations of these abstract strategies that students can 
inspect, manipulate, and test through practice. In this vein, it is instmctive that backward ch^^ 
alternative representation, and analogy strategies, for which their are no direct Logo 
representations, were the least likely to be developed by the students in our studies, while subgoab 
formation, forward chaining and systematfc trial aixl error strateg 

represented in the language, were the most likely to be developed In particular, no instructional 
effects at all were found for backward chaining strategies , most likely because it is not possible to 
develop programs backwards, hence, students had no procedural analog to Hnk to the declarative 
knowledge with which they were provided Likewise, the cut-paper manipulative* in Study Two 
probably dkl not provide students in that condition with anything like the quasi-concrete strategy 
models available in Logo programming. 



The development of problem solving and critical thinking skills is a crucial problem for 
education today. The research presented in this paper offers an instructional intervention for 
developing particular problem solving abilities. More importantly, it suggests that the Logo 
programming environment in particular, c omputin g environments in general, can perform a 
mediating rok in the development of problem solving abilities by supporting quaai-coocrete, 
dynamkrepresentatkxMofabstrart 

and formal thought when students are supplied with a declarative understanding at particular 
problem solving skills through expUcit knowledge-based instruction. If computing environments 
can indeed be designed to support such transitional objects for thinking, they might play an 
important role in the teaching and learning of problem solving. In today's educational climate, the 
notion certainly deserves furtherinvestigation. 
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SUBGOALS FORMATION 

(V) What is the problem? 

(57) What Kttle problems are a part of the problem? 
Make a tree. 

(X^Can you solve them? 

If yes, solve them and use yo ur tree to reassemble 
the parts. 

(3T)If no, go back to <£T)md. red o <£>nd CT)f or 
each of your smaller problems . 




FIGURE 1 
Wall Chart for Subgoals Formation 
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analogy 



1. Horizontal symmetry 

Put together at least 3 shapes to create a 
design in the upper r'ght quadrant of the 
screen, then draw the mirror image of 
your design in the lower right quadrant 




2. Vertical symmetry 

Put together at least 3 shapes to create a 
design in the upper right quadrant of the 
screen, then draw the mirror image of 
your design in the lower left quadrant 









— 1 







3. Diagonal symmetry 

Put together at least 3 shapes to create a 
design in the upper right quadrant of the 
screen, then draw the mirror image of 
your design in the lower right quadrant 





J- 







4. Mirrors 

Put together at least 3 shapes to create a 
design in the upper right quadrant of the 
screen, then draw the mirror images of 
your design in the other three quadrants. 




FIGURE 2 
Problem Set for Analogy 
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STUDY ONE: 
PRE- TO POST-TEST DIFFERENCES BY STRATEGY 
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STUDY ONE: 

PRE- TO POST-TEST DIFFERENCES BY GRADE LEVEL 
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STUDY TWO: 
UEAti PRE- TO POST-TEST DIFFERENCES 
BY STRATEGY AND GROUP 
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STUDY THREE: 
PRE- TO POST-TEST DIFFERENCES 
BY STRATEGY AND GROUP 
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APPENDIX 

Problem Solving Strategy Measures 
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3. The Sport Shop sold sneakers for one week at $30 a pair 
arid-made $1800.00. -The next week they reduced the price to 
$20.00 a pair and sold twice as many. How much money did 
they make altogether? 



4. Jean and Marie split a milk shake that cost $1-00. 
Marie didn't have quite enough money to P a J J« ^J 1 ^ 
She still owes Jean $.10. How much money did Jean put in 
for the milk shake? 



Subgoals formation. 

Our measure of students' ability to decompose complex problems 
into smaller subgoals units consisted of five mathematical word 
problems that required decomposition for correct solution. 
S dents were asked not only to solve the problems but to show 
how they broke them into parts. They were given credit for 
correctly identified subgoals as well as for the correct answer 
with a possible total of five points per question. 



34 

•3? 



® 



GRAY THINGS THAT ARB NEITHER. TRIAN3LES 
NOR CIRCLES 



A 




O 



EVERYTHING THAT ISN'T BLACK 




CROSSES OR STRIPED TRIANGLES 




EVERYTHING THAT IS EITHER A CIRCLE 
OR BLACK OR STREP HD 




O 



THINGS THAT ARB GRAY BUT NOT CROSSES 
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Forward Chaining. 

The test designed to measure subjects' forward chaining skills 
was a paper-and-pencil version of the computer game, Rocky s 
Books (The Learning Company, 1982). In Rocky's Boots, symbolic 
"AND" "OR" and "NOT" gates are combined to produce machines 
that respond to targeted attributes and sets of attributes 
(e.g., gray triangles, corsses or striped circles, everything 
that is not black, etc.). Combinations of gates must be built 
up in a forward chaining manner to achieve correct solutions. 
Our paper-and-pencil version had subjects draw the required 
connections. There was a total of fifteen questions which were 
given one point each for correct solution. 
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Backward chaining. 



The test designed to measure subjects' backward chaining skills was a 
paper-and-pencil adaptation of the computer game, The Factory (Sunburst, 
1984). In The Factory, players are shown a finished product and asked 
to combine various machines to produce a similar product. Thus, players 
must work backwards from the product to deduce a correct sequence of 
machines that will produce it. Our paper-and-pencil version had subjects 
list the required machine sequences. The test consisted of fifteen 
questions which were given one point each for correct solution. 
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SHIFTED ALPHAB ET: A SAYING: 
0 fczzvbu gbcta uohvsfg be aegg. 
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Systematic trial and error. 

Cryptography involved systematically trying and testing different symbol 
combinations to attain coherent decoding systems. We chose two decoding 
exercises to test subjects' abilities to systematically utilize trial 
and error strategies. The first of these was a shifted alphabetical 
code. The second involved variations on a number code problem devised 
by Newell and Simon (1971). Students were given ten points for 
correctly decoded problem. For partial solutions on the shifted 
alphabet problem, one half point was given for each correctly identified 
letter. On the number code problem, a full point was given for each 
correctly identified letter. 
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Use the squares to create as many interesting and unusual 
drawings as you can. 



Alternative representation 

The measure of subjects 1 ability to create alternative representation 
used was derived from the Torrance Test of Creative Thinking (Torrance, 
1972). Students were given sets of geometric fitures (squares or 
circles) and asked to use these to produce as many interesting and 
unusual drawings as they could. The resultant drawings were scored 
for quantitiy, diversity, originality, and elaboration. 




38 



1. 




2. 



V 



3. XYZ : ZAX 

4. ZAX : XYZ 



:: ABC 
:: XYZ 



CD- 



El 



6. B : W :: E 

7. E : 3 : P 
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Analogy 

Subjects 1 skill at analogical reasoning was measured with completion 
exercises consisting of ten verbal and ten visual analogies. Students 
were given one point for each correct answer. 
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